Facial Expression Recognition with Recurrent Neural Networks

نویسندگان

  • Alex Graves
  • Jürgen Schmidhuber
  • Christoph Mayer
  • Matthias Wimmer
  • Bernd Radig
چکیده

This paper presents a complete system for automatic facial expression recognition. The Candide-3 face model is used in conjunction with a learned objective function for face model fitting. The resulting sequence of model parameters is then presented to a recurrent neural network for classification. The advantage of using a recurrent network is that the temporal dependencies present in the image sequences can be taken into account during the classification. Since the entire process is automatic, and the recurrent networks can be used to make online predictions, the system would be ideal for real-time recognition. This would make it suitable for the CoTeSys ‘coffee break’ scenario, where guests must be recognised and served by robot waiters. Promising experimental results are presented on the Cohn-Kanade database.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Automatic Facial Expression Recognition Using Image Processing and Bayesian Regularized Recurrent Neural Network

Facial expressions can be considered as a means of communication by non-verbal signals. They are essential part of human relations. Automatic facial expressions recognition can be imperative for natural human-machine interaction. Automatic facial expressions recognition can be utilized in the field of behavioral science and in the health care department. Although humans perceive the facial expr...

متن کامل

Facial Action Unit Recognition from Video Streams with Recurrent Neural Networks

Facial expressions are one of the parameters for accessing individual behavioral processes. Their recognition and verification can be framed as the identification of states of dynamical systems generated by physiological processes. Whereas a snap shot of a dynamical system gives information about its current state, a time series of past states captures its trajectory in state space. The descrip...

متن کامل

Deep Convolutional Neural Networks for Smile Recognition

This thesis describes the design and implementation of a smile detector based on deep convolutional neural networks. It starts with a summary of neural networks, the difficulties of training them and new training methods, such as Restricted Boltzmann Machines or autoencoders. It then provides a literature review of convolutional neural networks and recurrent neural networks. In order to select ...

متن کامل

Introducing a method for extracting features from facial images based on applying transformations to features obtained from convolutional neural networks

In pattern recognition, features are denoting some measurable characteristics of an observed phenomenon and feature extraction is the procedure of measuring these characteristics. A set of features can be expressed by a feature vector which is used as the input data of a system. An efficient feature extraction method can improve the performance of a machine learning system such as face recognit...

متن کامل

Analysis and Synthesis of Facial Expressions by Feature-Points Tracking and Deformable Model

Face expression recognition is useful for designing new interactive devices offering the possibility of new ways for human to interact with computer systems. In this paper we develop a facial expressions analysis and synthesis system. The analysis part of the system is based on the facial features extracted from facial feature points (FFP) in frontal image sequences. Selected facial feature poi...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2008